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(54) Tide: CIRCUITRY FOR DECODING HUFFMAN CODES 



(57) Abstract 

A variable-length decoder system decodes a variable- 
length code having different code prefixes in an input bit 
stream. A code prefix is located in the bit stream and used to 
determine a number of bits to be selected from the input bit 
stream according to an access of a code book. Additionally, 
a pointer, directing access to a different code book, may also 
be indicated by the access of the first code book according to 
the located code prefix. A determination is made in this de- 
coder system whether to perform the operation of determin- 
ing a number of bits to be selected from the input stream or 
accessing a second code prefix table. If the code value is val- 
id, the number of bits is selected and appended to the code 
prefix to form a code word which is later decoded by the sys- 
tem of the present invention. If another table is indicated a 
further code prefix is located in the input stream and the fur- 
ther lookup table is accessed in accordance with the further 
code prefix. 
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CIRCUITRY FOR DECODING HUFFM AN CODES 
Background of Th e Invention 

1. Field of the Invention 

This invention relates to the field of circuitry for 
decoding variable-length encoded data and in particular to 
circuitry for decoding variable-length encoded data having an 
unrestricted set of code words. 

2. Background Art 

Advances in the field of digital data processing have 
generated a demand for systems which can transfer, process, and 
store relatively large amounts of digital data. It is therefore 
often desirable that this digital data be compressed so that it 
may be more efficiently transmitted and so that it may be stored 
in a relatively small amount of memory. 

An example of a digital data processing system 
requiring the transfer, processing, and storage of a relatively 
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large volume of digital data is a video signal processing system. 
For example, a conventional video signal processing system may „ 
provide an image broken down into two hundred forty lines. Each 
line of the image may contain two hundred fifty six eight-bit 
independent pixel values. A video signal processing system of 
this type therefore requires 61,440 bytes for each image frame. 
Assuming an image display rate of thirty frames per second, this 
video processing system has a data rate of 1,843,200 bytes per 
second. 

It is well known that the number of bytes per frame in 
a video signal processing system may be reduced by encoding in 
order to compress the video data. A prior art system of this 
type for encoding video data is described,, for example, in U.S. 
Patent No. 4,125,861, entitled "Video Signal Encoding", which is 
incorporated by reference herein. In the video processing system 
described in this reference, the digital video data are first 
compressed using a differential pulse code modulation technique. 
The compressed data are then encoded using a variable-length 
code. In variable-length codes of this type the statistically 
more frequently occurring data values are assigned to the shorter 
code words and less frequently occurring data values are assigned 
to the longer code words. Thus fewer bits are required to encode 
the data. As used in this application, this type of encoding is 
referred to as statistical encoding. 
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One method known in the prior art for statistically 
encoding data in this manner is the use of an optimal variable- 
length code such as a Huffman code. To use a Huffman code, the 
data to be transmitted is put in order, from the most frequently 
occurring data values to the least frequently occurring ones. A 
Huffman code is then generated using, for example, the algorithm 
described at pages 77-85 of Information Theory and Coding by N. 
Abramson, McGraw Hill, 1963, which is incorporated by reference 
herein. Using this method, a code book which gives the 
correspondence between the data values and the code values is 
transmitted along with the encoded data . The transmitted code 
book permits the system which decodes the data to translate the 
code values into their corresponding data values. Because of the 
overhead of transmitting and storing the code book containing the 
encoded data this encoding technique is practical only when a 
relatively large amount of data is transmitted or stored. 

It is well known in the art to use this statistical 
decoding method for codes of the form: 

[11... 10] [x(N) bits] 

or 

[00. . .01] [x(N) bits] 

wherein N is the number of leading ones in the code prefix 
[11... 10] or the number of leading zeros in the code prefix 
[00... 01], and x(N) is a function of N specifying the number of 
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bits forming the code value which follows the code prefix. In 
this method statistical decoding is performed by first scanning 
the input bits to be decoded and locating a code prefix. For 
example see U.S. Patent No. 4,125,861. Then x(N) additional bits 
are fetched according to the length N of the located prefix. The 
fetched x(N) bits form a code value which serves as a unique 
index number. A unique index number indicates a data value which 
was previously encoded to represent one unique code in the code 
book. The code book may be specified by a small arcount of memory 
containing the x(N) values. 

Another known for statistically encoding data is 
processing the data according to a predetermined algorithm to 
obtain data having a statistical distribution of values which 
generally approximates a known distribution. The data are then 
encoded, using a code which has been adapted for the known 
distribution, transmitted, and then decoded using a fixed code 
book which is the inverse of the code book used to encode the 
data values. 

U.S. Patent No. 4,125,861 teaches a statistical system 
of this type wherein processing of data is performed to obtain a 
statistical distribution. Differential pulse code modulation 
processing is performed on input data by this system to produce 
data having a value distribution that has a peak at zero and 
falls off in a roughly exponential form on either side of the 
peak. These data are then statistically encoded using a preset 
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code book stored in a read only memory. The data are then 
transmitted to a receiver which decodes the data using the 
inverse table, also stored in a read only memory. 

A statistical system of the type taught in U.S. Patent 
No. 4,125,861, has the advantage that it significantly compresses 
the input data and does not require transmission of a code book 
along with the compressed data. However, this type of 
statistical system has the disadvantage that the level of 
compression of the data obtained may not be as good as that which 
may be obtained if a more tailored statistical encoding scheme 
which is adapted to the data is used. 

It would therefore be advantageous if a data encoding 
and decoding system could be provided that efficiently encoded 
data having a variety of statistical patterns but did not require 
restrictions on the permitted code book. 

SUMMARY OF THE INVENTION 

A variable-length decoder system decodes a variable- 
length code having different code prefixes in an input bit 
stream. A code prefix is located in the bit stream and used to 
determine a number of bits to be selected from the input bit 
stream according to an access of a code book. Additionally, a 
pointer, directing access to a different code book, may also be 
indicated by the access of the first code book according to the 
located code prefix. 
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BPTTTF D ESCRIPTION OF THE DRAWING 

Fig. 1 shows a block diagram representation of the 
system for decoding Huffman codes of the present invention. 

Fig. 2 shows a block diagram representation of 
recursive code books of the decoding system of Fig. 1. 

DETAILED DESCRIPTION OF THE INVENTION 

Referring generally to the drawings, there are shown 
variable-length statistical decoder system 10 and recursive code 
books 30, 40 of the present invention. Variable-length 
statistical decoder system 10 is adapted to permit recursive 
access to code books 30 , 40 during the decoding of a variable- 
length encoded input bit stream wherein the number of code books 
available for access is restricted only by the amount of memory 
space available for storing the code books- This type of 
recursive access to code books 30, 40 permits an unrestricted set 
of code words within statistical decoder system 10. 

Variable-length statistical decoder system 10 begins by 
scanning the encoded input bit stream until a prefix including 
some number of one bits followed by a zero bit has been obtained. 
Statistical decoder system 10 use the located code prefix to 
access a row in a recursive code table x(N) . An entry in the 
accessed row of the code book x(N) instructs statistical decoder 
system 10 to either (1) fetch x(N) additional bits of the 
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variable-length encoded bit stream input, or (2) restart scanning 
the input bit stream for a second variable-length code prefix in 
order to access a row of a further recursive code book x' (N) . 

In the latter case, when a second variable-length code 
prefix is located, the accessed row of the further code book 
x'(N) is again used to specify either (1) a fetch of x' (N) 
additional bits from the input bit stream corresponding to the 
second code prefix, or (2) a further scan of the input bit stream 
to locate a third code prefix in order to access a third code 
book x"(N). When this third code prefix is found, statistical 
decoder system 10 makes a further determination whether to (1) 
fetch another x ,f (N) bits from the input bit stream or (2) to 
search for another code prefix for accessing a still further code 
book. This recursive statistical decoding process may continue 
for as many recursions as required. 

Thus the input bit stream representing the data values 
which were encoded using a variable-length code are scanned and a 
code prefix is located as shown in prefix scan block 12 of 
variable-length statistical decoder system 10. When a code 
prefix is located in prefix scan block 12, a selected row of 
current recursive code book 30 is accessed according to the value 
of the code prefix as indicated in code book lookup block 16. 
Code book 3 0 contains the values x(N) which indicate the number 
of bits to be fetched from the input bit stream for various 
values of N. A determination is thus made by statistical decoder 
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system 10 whether a valid value of x(N) is associated with the 
row of recursive code book 30 accessed by the located code prefix 
as shown in decision diamond 18. 

For example, during execution of prefix scan block 12 
statistical decoder system 10 may locate a code prefix indicated 
as binary value 11110 in the variable-length encoded input bit 
stream 30. Access to code book row 34 of recursive code book 30 
is then made according to located code prefix 1111 during 
execution of lookup block 16 as shown in code prefix field 35 of 
row 34. Statistical decoder system 10 of the present invention 
returns a x(N) value of six from this lookup as shown in field 37 
of row 34. Since N(4)=6 is a valid code, statistical decoder 
system 10 proceeds to code value fetch block 20 and fetches the 
next six bits of the variable-length encoded input bit stream and 
appends the fetched six bits as a code value to the located code 
prefix 1111. These six bits are later decoded within statistical 
decoder system 10. 

However, if variable-length statistical decoder system 
10 determines, in decision diamond 18, that the value x(N) of an 
accessed code book row of recursive code book 3 0 is not valid, 
statistical decoder system 10 does not fetch x(N) bits from the 
input stream. Instead, statistical decoder system 10 uses a code 

■ 

book pointer entry within the accessed row of recursive code book 

30 to access a further recursive code book, such as recursive r 

code book 40. 
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For example, if a code prefix indicated as binary value 
1110 is located in prefix scanning block 12 of statistical 
decoder system 10, code book row 32 of recursive code book 30 is 
selected. The entry in field 36 of code book row 34 indicates to 
statistical decoder system 10 that a further recursive code book 
x'(N) is required as indicated by pointer arrow 38. Thus, 
statistical decoder system 10 uses recursive code book 40 or code 
book x'(N) for the next access as indicated in table update block 
14. 

After execution of table update block 14 , a new code 
prefix is located within the encoded input bit stream as shown in 
prefix scan block 12. A code book row within recursive code book 
40 is selected according to the newly located code prefix as 
shown in code book lookup block 16, and a determination is made 
in decision diamond 18 whether x 1 (N) for the selected N is valid. 
If it is valid execution of statistical decoder system 10 
proceeds to code value fetch block 20 where the x' (N) value is 
used to select bits to be fetched from the encoded input bit 
stream. 

It will be understood by those skilled in the art that 
the value of x 1 (N) selected in recursive code book 40 by 
statistical decoder system 10 may indicate that a further 
recursive code book x ! '(N) (not shown) should be selected rather 
* than a fetch of x' (N) bits from the input bit stream. This 

determination is made by decision diamond 18. For example code 
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book rows 42 , 44 of recursive code book 40 indicate that further 
code books should be accessed rather than performing a fetch of 
the next *• (N) bits of the input bit stream. If it is determined 
that a further recursive code book is required, in accordance 
with decision diamond 18, execution again proceeds to code book 
update block 14 where the indicated further code book becomes the 
current code book. 

It will be further understood by those skilled in the 
art that recursive code book 30 may be selected by recursive code 
book 40. For example the x'(N) entry of code book row 44 within 
recursive code book 40 indicates access to recursive code book 
30. Additionally, it will be understood that the number of 
differing recursive code books which may be provided within 
variable-length statistical decoder system 10, for access by way 
of recursive code books 30, 40, is limited only by the size of 
the memory available to store the recursive code books. 

Variable-length statistical decoder system 10 may thus 
be used to decode variable-length statistically encoded words of 
the form [11. ..10] [11. ..10] ... [11. ..10] [x(Nl,N2, . . .Nk) bits]. 
A polarity bit may be used to instruct decoder 10 on the form for 
decoding the code words. Furthermore, the complexity of the 
Huffman trees which can be decoded using statistical decoder 
system 10 is limited only by the amount of RAM provided. 

While this inventions has been described with respect 
to specific, and particularly preferred, embodiments thereof, it 
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is not limited thereto and the impended claims are intended to be 
construed to encompass not only the specific forms and variance 
of the invention shown but to such other forms and variance as 
may be devised by those skilled in the art without department 
from the true spirit and scope of this invention. 
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CIAIMS 

1 # A variable-length decoder system for decoding a 
variable-length code having a plurality of code values 
representing encoded data and a plurality of differing code 
prefixes in a variable-length encoded input bit stream , 
comprising: 

means for determining a first code prefix of said 
plurality of cod-> prefixes in said input bit stream; 

first code book means for determining a first 
number of first selected bits to be fetched from said input bit 
stream in accordance with said first code prefix; 

second code book means for determining a second 
number of second selected bits to be fetched from said input bit 
stream; and, 

said first code book means having first indicating 
means for indicating said second code book means in accordance 
with said first code prefix. 

2. The variable-length decoder system of Claim 1, 
comprising means for further determining in accordance with said 
first code prefix whether to fetch said first selected bits from 
said input bit stream. 
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3. The variable-length decoder system of Claim 2, 
wherein said first selected bits comprise a code value of said 
plurality of code values. 

4. The variable-length decoder system of Claim 1, 
comprising means for further determining in accordance with said 
first code prefix whether to access said indicated second code 
book means. 

5. The variabls-length decoder system of Claim 1, 
further comprising means for selecting a second code prefix of 
said plurality of code prefixes in said input bit stream. 

6. The variable-length decoder system of Claim 5, 
wherein said second code book means is adapted to determine said 
number of said second selected bits in accordance with said 
second code prefix. 

7. The variable-length decoder system of Claim 5, 
having third code book means wherein said second code book means 
comprises second indicating means for indicating said third code 
book means. 

8. The variable-length decoder system of Claim 1, 
wherein said second indicating means further comprises means for 
indicating said third code book means in accordance with said 
second code prefix. 
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9. A method for variable-length decoding of a 
variable-length code having a plurality of code values 
representing encoded data and a plurality of differing code 
prefixes in a variable-length encoded input bit stream, 
comprising the steps of: 

(a) .determining a first code prefix of said 
plurality of code prefixes in said input bit stream; 

(b) determining by first code book means a first 
number of first selected bits to be fetched from said input bit 
stream in accordance with said first code prefix; 

(c) determining by second code book means a second 
number of second selected bits to be fetched from said input bit 
stream; and, 

(d) first indicating said second code book means 
in accordance with said first code prefix by said first code book 
means. 

10> The method for variable-length decoding of Claim 

9, comprising the step of further determining in accordance with 
said first code prefix whether to fetch said first selected bits 
from said input bit stream. 

11. The method for variable-length decoding of Claim 

10, wherein said first selected bits comprise a code value of 
said plurality of code values. 
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12. The method for variable-length decoding system of 
Claim 11, comprising the step of further determining in 
accordance with said first code prefix whether to access said 
second code book means. 

13. The method for variable-length decoding of Claim 
9, comprising the further step of selecting a second code prefix 
of said plurality of code prefixes in said input bit stream. 

14. The method for variable-length decoding of Claim 
13 , wherein said second code book means is adapted to determine 
said second number of said second selected bits in accordance 
with said second code prefix. 

15. The method for variable-length decoding of Claim 
13 , in a system having third code book means further comprising 
the step of second indicating by said second means third of code 
book means in accordance with said second code prefix. 

16. The method for variable-length decoding of Claim 
13 , wherein said second indicating means comprises means for 
indicating said third code book means in accordance with said 
second code prefix. 

17. The method for variable-length decoding of Claim 
15, wherein said first code* book means and said third code book 
means are identical. 



-15- 



WO 93/13603 PCT/US92/10679 



c 



START 



J 



12 

± 



PREFIX SCAN 



14 



NEW 
CODE BOOK 



16 



ACCESS 
CODE BOOK 




FETCH BITS 



FIG. 1 



10 



30 



40 



N 



32 

c 

34 



1 
2 
3 
4 

T 

5 



CODE PREFIX 



'1 
1 1 



1 

1 1 
1 1 
1 1 
1 1 



x(N) 



0 
0 
0 
0 
0 
0 



m 



3 
2 
5 



36 
1/ 



3 x ' 38 
«'(N) -< 



37 



N 


CODE PREFIX 




x'(N) 


1 




0 


5 


2 




0 


x"(N) 


3 


1 1 


0 


1 


4 


1 1 1 


0 


3 


4 


1111 


0 


x(N) 


5 


11111 


0 


4 


X'(N) 



42 

D 

44 

D 



FIG. 2 



1 /1 



INTERNATIONAL SEARCH REPORT PCT/US 92/10679 

Internationa] Application n»o 



I. CLASSIFICATION OF SUBJECT MATTER (if several classification symbols apply, indicate all)* 
Accor d in g to international Patent Classification (IPC) or to both Nat i on al Classification and IPC 

Int. CI. 5 H03M7/42 



H. FIELDS SEARCHED 



Mi h | p tttm DocumentatlOD Searched^ 



Classification System 


Classification Symbols 


Int. CI. 5 


H03M 



Docnmentation Searched other than Minimum Documentation 
to the Extent that such Documents are Included in the Fields Searched 8 



ID. DOCUMENTS CONSIDERED TO BE RELEVANT 9 



Category 0 



Citation of Document, 11 with indication, where appropriate, of the relevant passages 12 



Relevant to Claim No. 13 



EP,A,Q 286 719 (IBM) 

19 October 1988 

see the whole document 

US, A, 3 883 847 (FRANK) 
13 May 1975 

see the whole document 

WO, A, 8 905 556 (GENERAL ELECTRIC) 

15 June 1989 

see the whole document 

EP,A,0 145 396 (CROSFIELD) 
19 June 1985 

see page 7, line 33 - page 8, line 21 



° Special categories of dted documents : 10 

'A* document defining the general state of the art which is not 

considered to be of particular relevance 
"E* earlier document but published on or after the international 

filing date 

"L" document which may throw doubts on priority daintfs) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

'O* document referring to an oral disclosure, use, exhibition or 
other means 

T" document published prior to the international filing date bat 
later than the priority date daimed 



T* later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

*X* document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step 

"Y" document of particular relevance; the daimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
in the art. 

document member of the s 



Date of the Actual Completion of the International Search 

12 MARCH 1993 


Date of Mailing of this International Search Report 

1 a 03. 93 


International Searching Authority 

EUROPEAN PATENT OFFICE 


Signature of Authorized Officer 

FEUER F.S. 



aPCT/lSA/2lO(i 



JHJwauy tttS) 



ANNEX TO THE INTERNATIONAL SEARCH REPORT 

ON INTERNATIONAL PATENT APPLICATION NO. US 9210679 

SA 68227 



This annex lists the patent family members relating to the patent documents cited in the above-mentioned international search report* 
The members are as contained in the European Patent Office EDP He on 

The European Patent Office is in no way liable for these particulars which are merely given for the purpose of information. 12/03/93 



Patent document 


Publication 


Patent family 


Pn Mi cat ion 


cited in search report 


date 


memberfs) 


date 



EP-A-0286719 19-10-88 None 



US-A-3883847 


13-05-75 


BE-A- 


827319 


16-07-75 






CA-A- 


1055611 


29-05-79 






DE-A.C 


2513862 


02-10-75 






FR-A.B 


2266382 


24-10-75 






GB-A- 


1508653 


26-04-78 






JP-A- 


50131726 


18-10-75 


W0-A-8905556 


15-06-89 


US-A- 


4813056 


14-03-89 






EP-A- 


0395709 


07-11-90 






JP-T- 


3501555 


04-04-91 


EP-A-0145396 


19-06-85 


JP-A- 


60140981 


25-07-85 






US-A- 


4647908 


03-03-87 



For more detaOs about this annex : see Official Journal of the European Patent Office, No. 12/82 



